Pandas Profiling Report

Dataset statistics

Number of variables	12
Number of observations	691
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	64.9 KiB
Average record size in memory	96.2 B

Variable types

NUM	11
BOOL	1

Reproduction

Analysis started	2020-06-17 14:04:22.803543
Analysis finished	2020-06-17 14:05:15.908355
Duration	53.1 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`Uniformity of Cell Shape` is highly correlated with `Uniformity of Cell Size`	High correlation
`Uniformity of Cell Size` is highly correlated with `Uniformity of Cell Shape`	High correlation
`df_index` has unique values	Unique
`Bare Nuclei` has 413 (59.8%) zeros	Zeros

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct count	691
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	348.9479015918958
Minimum	0
Maximum	698
Zeros	1
Zeros (%)	0.1%
Memory size	5.4 KiB

Quantile statistics

Minimum	0
5-th percentile	34.5
Q1	172.5
median	351
Q3	523.5
95-th percentile	662.5
Maximum	698
Range	698
Interquartile range (IQR)	351

Descriptive statistics

Standard deviation	202.3461166
Coefficient of variation (CV)	0.5798748629
Kurtosis	-1.207385754
Mean	348.9479016
Median Absolute Deviation (MAD)	176
Skewness	-0.006482664191
Sum	241123
Variance	40943.95091

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
698	1	0.1%
227	1	0.1%
235	1	0.1%
234	1	0.1%
233	1	0.1%
232	1	0.1%
231	1	0.1%
230	1	0.1%
229	1	0.1%
228	1	0.1%
Other values (681)	681	98.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	0.1%
1	1	0.1%
2	1	0.1%
3	1	0.1%
4	1	0.1%

Value	Count	Frequency (%)
698	1	0.1%
697	1	0.1%
696	1	0.1%
695	1	0.1%
694	1	0.1%

ID
Real number (ℝ_≥0)

Distinct count	645
Unique (%)	93.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1073333.4356005788
Minimum	61634
Maximum	13454352
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	61634
5-th percentile	411876.5
Q1	872549
median	1171710
Q3	1238437
95-th percentile	1333946
Maximum	13454352
Range	13392718
Interquartile range (IQR)	365888

Descriptive statistics

Standard deviation	619295.2971
Coefficient of variation (CV)	0.5769831411
Kurtosis	256.8890813
Mean	1073333.436
Median Absolute Deviation (MAD)	104381
Skewness	13.68366131
Sum	741673404
Variance	3.83526665e+11

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1182404	6	0.9%
1276091	5	0.7%
734111	2	0.3%
1240603	2	0.3%
385103	2	0.3%
560680	2	0.3%
1174057	2	0.3%
822829	2	0.3%
1198641	2	0.3%
1114570	2	0.3%
Other values (635)	664	96.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
61634	1	0.1%
63375	1	0.1%
76389	1	0.1%
95719	1	0.1%
128059	1	0.1%

Value	Count	Frequency (%)
13454352	1	0.1%
8233704	1	0.1%
1371920	1	0.1%
1371026	1	0.1%
1369821	1	0.1%

Clump Thickness
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.426917510853835
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	6
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.815860703
Coefficient of variation (CV)	0.6360770663
Kurtosis	-0.6242633153
Mean	4.426917511
Median Absolute Deviation (MAD)	2
Skewness	0.5915025806
Sum	3059
Variance	7.929071499

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	142	20.5%
5	129	18.7%
3	106	15.3%
4	80	11.6%
10	69	10.0%
2	50	7.2%
8	46	6.7%
6	33	4.8%
7	23	3.3%
9	13	1.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	142	20.5%
2	50	7.2%
3	106	15.3%
4	80	11.6%
5	129	18.7%

Value	Count	Frequency (%)
10	69	10.0%
9	13	1.9%
8	46	6.7%
7	23	3.3%
6	33	4.8%

Uniformity of Cell Size
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	10
Unique (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.130246020260492
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	5
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	3.041328337
Coefficient of variation (CV)	0.9715940273
Kurtosis	0.1063917487
Mean	3.13024602
Median Absolute Deviation (MAD)	0
Skewness	1.233241438
Sum	2163
Variance	9.249678055

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	379	54.8%
10	65	9.4%
3	51	7.4%
2	45	6.5%
4	40	5.8%
5	30	4.3%
8	29	4.2%
6	27	3.9%
7	19	2.7%
9	6	0.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	379	54.8%
2	45	6.5%
3	51	7.4%
4	40	5.8%
5	30	4.3%

Value	Count	Frequency (%)
10	65	9.4%
9	6	0.9%
8	29	4.2%
7	19	2.7%
6	27	3.9%

Uniformity of Cell Shape
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	10
Unique (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.2011577424023154
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	5
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.959886179
Coefficient of variation (CV)	0.924629905
Kurtosis	0.01849497393
Mean	3.201157742
Median Absolute Deviation (MAD)	0
Skewness	1.163698359
Sum	2212
Variance	8.760926194

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	348	50.4%
2	59	8.5%
10	56	8.1%
3	56	8.1%
4	44	6.4%
5	33	4.8%
7	30	4.3%
6	30	4.3%
8	28	4.1%
9	7	1.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	348	50.4%
2	59	8.5%
3	56	8.1%
4	44	6.4%
5	33	4.8%

Value	Count	Frequency (%)
10	56	8.1%
9	7	1.0%
8	28	4.1%
7	30	4.3%
6	30	4.3%

Marginal Adhesion
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.824891461649783
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	2.8665517
Coefficient of variation (CV)	1.014747554
Kurtosis	0.9320711039
Mean	2.824891462
Median Absolute Deviation (MAD)	0
Skewness	1.507562523
Sum	1952
Variance	8.217118648

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	401	58.0%
3	58	8.4%
2	56	8.1%
10	55	8.0%
4	33	4.8%
8	25	3.6%
5	23	3.3%
6	22	3.2%
7	13	1.9%
9	5	0.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	401	58.0%
2	56	8.1%
3	58	8.4%
4	33	4.8%
5	23	3.3%

Value	Count	Frequency (%)
10	55	8.0%
9	5	0.7%
8	25	3.6%
7	13	1.9%
6	22	3.2%

Single Epithelial Cell Size
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.211287988422576
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	2
Q3	4
95-th percentile	8
Maximum	10
Range	9
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	2.199852417
Coefficient of variation (CV)	0.6850374134
Kurtosis	2.215127492
Mean	3.211287988
Median Absolute Deviation (MAD)	0
Skewness	1.719041483
Sum	2219
Variance	4.839350658

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2	383	55.4%
3	71	10.3%
4	48	6.9%
1	45	6.5%
6	41	5.9%
5	39	5.6%
10	30	4.3%
8	20	2.9%
7	12	1.7%
9	2	0.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	45	6.5%
2	383	55.4%
3	71	10.3%
4	48	6.9%
5	39	5.6%

Value	Count	Frequency (%)
10	30	4.3%
9	2	0.3%
8	20	2.9%
7	12	1.7%
6	41	5.9%

Bare Nuclei
Real number (ℝ_≥0)

ZEROS

Distinct count	10
Unique (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.1881331403762663
Minimum	0
Maximum	9
Zeros	413
Zeros (%)	59.8%
Memory size	5.4 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	7
Maximum	9
Range	9
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	2.128326107
Coefficient of variation (CV)	1.791319537
Kurtosis	3.86311774
Mean	1.18813314
Median Absolute Deviation (MAD)	0
Skewness	2.141039472
Sum	821
Variance	4.529772017

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	413	59.8%
1	130	18.8%
5	30	4.3%
2	30	4.3%
3	28	4.1%
8	20	2.9%
4	19	2.7%
9	9	1.3%
7	8	1.2%
6	4	0.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	413	59.8%
1	130	18.8%
2	30	4.3%
3	28	4.1%
4	19	2.7%

Value	Count	Frequency (%)
9	9	1.3%
8	20	2.9%
7	8	1.2%
6	4	0.6%
5	30	4.3%

Bland Chromatin
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.435600578871201
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	3
Q3	5
95-th percentile	8
Maximum	10
Range	9
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	2.442345103
Coefficient of variation (CV)	0.710893204
Kurtosis	0.1898953894
Mean	3.435600579
Median Absolute Deviation (MAD)	1
Skewness	1.102753118
Sum	2374
Variance	5.965049603

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2	165	23.9%
3	161	23.3%
1	151	21.9%
7	71	10.3%
4	40	5.8%
5	34	4.9%
8	28	4.1%
10	20	2.9%
9	11	1.6%
6	10	1.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	151	21.9%
2	165	23.9%
3	161	23.3%
4	40	5.8%
5	34	4.9%

Value	Count	Frequency (%)
10	20	2.9%
9	11	1.6%
8	28	4.1%
7	71	10.3%
6	10	1.4%

Normal Nucleoli
Real number (ℝ_≥0)

Distinct count	10
Unique (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.882778581765557
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	10
Maximum	10
Range	9
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	3.066297646
Coefficient of variation (CV)	1.063660479
Kurtosis	0.4263861649
Mean	2.882778582
Median Absolute Deviation (MAD)	0
Skewness	1.407485407
Sum	1992
Variance	9.402181254

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	437	63.2%
10	61	8.8%
3	42	6.1%
2	36	5.2%
8	24	3.5%
6	22	3.2%
5	19	2.7%
4	18	2.6%
9	16	2.3%
7	16	2.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	437	63.2%
2	36	5.2%
3	42	6.1%
4	18	2.6%
5	19	2.7%

Value	Count	Frequency (%)
10	61	8.8%
9	16	2.3%
8	24	3.5%
7	16	2.3%
6	22	3.2%

Mitoses
Real number (ℝ_≥0)

Distinct count	9
Unique (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.593342981186686
Minimum	1
Maximum	10
Zeros	0
Zeros (%)	0.0%
Memory size	5.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	1
95-th percentile	5
Maximum	10
Range	9
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	1.723128843
Coefficient of variation (CV)	1.081455069
Kurtosis	12.51342181
Mean	1.593342981
Median Absolute Deviation (MAD)	0
Skewness	3.544555352
Sum	1101
Variance	2.969173011

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	572	82.8%
2	35	5.1%
3	32	4.6%
10	14	2.0%
4	12	1.7%
7	9	1.3%
8	8	1.2%
5	6	0.9%
6	3	0.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	572	82.8%
2	35	5.1%
3	32	4.6%
4	12	1.7%
5	6	0.9%

Value	Count	Frequency (%)
10	14	2.0%
8	8	1.2%
7	9	1.3%
6	3	0.4%
5	6	0.9%

Class
Boolean

Distinct count	2
Unique (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	5.4 KiB

1	453
0	238

Frequency Table

Value	Count	Frequency (%)
1	453	65.6%
0	238	34.4%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

First rows

	df_index	ID	Clump Thickness	Uniformity of Cell Size	Uniformity of Cell Shape	Marginal Adhesion	Single Epithelial Cell Size	Bare Nuclei	Bland Chromatin	Normal Nucleoli	Mitoses	Class
0	0	1000025	5	1	1	1	2	0	3	1	1	1
1	1	1002945	5	4	4	5	7	1	3	2	1	1
2	2	1015425	3	1	1	1	2	2	3	1	1	1
3	3	1016277	6	8	8	1	3	4	3	7	1	1
4	4	1017023	4	1	1	3	2	0	3	1	1	1
5	5	1017122	8	10	10	8	7	1	9	7	1	0
6	6	1018099	1	1	1	1	2	1	3	1	1	1
7	7	1018561	2	1	2	1	2	0	3	1	1	1
8	8	1033078	2	1	1	1	2	0	1	1	5	1
9	9	1033078	4	2	1	1	2	0	2	1	1	1

Last rows

	df_index	ID	Clump Thickness	Uniformity of Cell Size	Uniformity of Cell Shape	Marginal Adhesion	Single Epithelial Cell Size	Bare Nuclei	Bland Chromatin	Normal Nucleoli	Mitoses	Class
681	689	654546	1	1	1	1	2	0	1	1	8	1
682	690	654546	1	1	1	3	2	0	1	1	1	1
683	691	695091	5	10	10	5	4	5	4	4	1	0
684	692	714039	3	1	1	1	2	0	1	1	1	1
685	693	763235	3	1	1	1	2	0	2	1	2	1
686	694	776715	3	1	1	1	3	2	1	1	1	1
687	695	841769	2	1	1	1	2	0	1	1	1	1
688	696	888820	5	10	10	3	7	3	8	10	2	0
689	697	897471	4	8	6	4	3	4	10	6	1	0
690	698	897471	4	8	8	5	4	5	10	4	1	0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows